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ANALYTICAL MODELS AND SYSTEM TOPOLOGIES FOR REMOTE 


MLLTISPECTRAL DATA ACQUISITION AND CLASSIFICATION 


Friedrich 0. Huck, Stephen K. Park, Ernest E. Burcher, 
and W. Lane Kelly, IV 
Langley Research Center 


SUMMARY 

This paper presents simple analytical models of the radiometric and 
statistical processes that are involved in multispectral data acquisition and 
classification. These models represent a preliminary but systematic step 
towards the use of computer simulations to gain a better understanding of the 
effect of major error sources on classification. This paper presents also 
some basic system topologies which combine remote sensing with data 
classification. Simulations of these topologies are intended to aid in the 
analysis of techniques for reducing classification errors and computations. 
However, before these models and topologies can be relied upon to yield 
jsetul results, they must be expanded to account more rigorously for 
target properties, atmospheric effects, and system component characteristics. 


INTRODUCTION 

There is a rapidly increasing demand for world-wide resource and 
environmental tnonitoring. This demand is currently met with several space- 
craft multispectral imaging systems (such as Landsat) that transmit all 
acquired data (together with calibration data) to earth for processing in 
computer laboratories. Supporting studies tend to concentrate on specific 
aspects of remote sensing and data classification such as reflectance 
properties of objects, effects of the atmosphere, instrument technology, and 
data processing algorithms. Systematic analysis that account for all phases 
of the multispectral data acquisition and classification process and its 
error sources appear to be lacking, except for a recent study by 
Kondrat'yev et al. (ref. 1) in which remote sensing is analyzed from the 
viewpoint of information theory. 

As the number of remote sensors and their spatial and spectral 
resolutions increase, the associated multispectral data transmission, 
storage, and processing requirements become excessively cumbersome and 
expensive to satisfy. Hence, it should become increasingly desirable to 
process multispectral data onboard the spacecraft itself. The onboard 
processing may initially be limited to editing; that is, for example, to the 
rejection of all data from clouds, or to the selection of all data containing 
information about venetation. 
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This approach suggests a two-level decision process in which a simple 
level -1 decision process acts as a filter to reduce data loads for a more 
sophisticated level -2 decision process that classifies data, for example, 
as types of vegetation and soil. In fact, a two-level decision process may 
reduce the required number of computations in many applications as it has 
been demonstrated already for the classification of military targets (ref. 2 ). 

As the reliance on remote sensing and data classification increases, 
it becomes also more important to better understand error sources in 
classification, and, if possible, to devise techniques for reducing their 
effect. Errors are Introduced by variations of the spectral reflectance of 
various classes of objects, by variations in Imaging conditions (such as 
atmospheric effects and lighting and viewing geometry) and imaging system 
response (such as calibration and noise), and by the models or training data 
used as reference patterns. 

Limitations imposed on remote sensing by the atmosphere are particularly 
severe (ref. 3 ), and the compensation for atmospheric conditions has been 
strongly advocated (ref. 4). Initial investigations (refs. 5 to 9) 

Indicate that compensation for atmospheric effects can indeed effectively 
reduce classification errors when signal patterns are acquired under 
atmospheric conditions that differ from those conditions that prevailed 
when training data were obtained. 

In this paper we present simple analytical models of the complex 
radiometric and statistical processes that are involved in multispectral 
data acquisition and classification, and basic spacecraft system topologies 
which integrate these two functions. These models and topologies provide a 
preliminary but systematic approach for using computer simulations to gain a 
better understanding of the effect of major error sources on classification, 
and to aid in the analysis of techniques for reducing classification errors 
and computations. 


ac(») 

a^(X) 

ao(X) 

^0 

C^(X, X') 


SYMBOLS 

selective absorption coefficient of carbon dioxide (CO 2 ). cm 

selective absorption coefficient of water vapor (H 2 O), cm ^ 

selective absorption coefficient of ozone (O 3 ), cm ^ 

equivalent concentration of carbon dioxide (CO 2 ). cm 
equivalent concentration of water vapor (H 2 O), cm 
equivalent concentration of ozone ( 0^)1 cm 
covariance of spectral radiance 
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covariance of spectral reflectance 
sensitivity, V-W’^-cm^-ster 

11 lunilnatlon scattering function, see equation (4) 

dark current offset, V 

hypothesis 

number of picture elements per line 

Imaging conditions, see equations (22) and (31) 

number of spectral channels, or dimensionality 

number of classes of objects 

number of broad categories of objects 

mean-square distance, V , see equation (36) 

number of classes of objects contained within a broad category 

number density of aerosol integrated over height, km 

-2 

number density of air molecules Integrated over height, m 

-2 -1 -1 

spectral radiance, W-cm -^m -sr 

probability density function, see equation (38) 

reference component, V, see equations (8), (17), and (18) 

reference component normalized for imaging condition, V, 
see equation (29) 

error-free calibrated signal component, V, see equation (7) 
uncalibrated signal component, V, see equation (6) 
calibrated signal component, V, see equation (42) 

-2 -1 

solar spectral Irradlance above earth atmosphere, W-cm -pm 
normalized responsivlty, see equation (5) 
standard deviation of spectral radiance 
standard dewlatlon of spectral reflectance 
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Y 

a( a) 
6 ( ) 


0 

X 

A 

A 

p( ) 

°jj’ 

0|^(A) 
t( ) 

Subscripts: 


difference component between signal and reference, V, see 
equations (35) and (46) 

extinction optical thickness of atmosphere, see equation (2) 

attenuation coefficient of aerosol, km’^ 

correlation element of reference signal, see equation (14) 

delta or unit impulse function 

emittance angle, degree or radian 

sensitivity calibration error. V. see equation (44) 

dark current offset calibration error. V. see equation (45) 

radiometric calibration error. V. see equation (43) 

slant path angle, degree or radian 

incidence angle, degree or radian 

spectral width of photosensor channel 

wavelength, um 

spectral reflectance, see equation (3) 
standard deviation element of reference pattern 
covariance element of reference pattern 

2 

Rayleigh cross-section of air molecules, m 
spectral transmittance of atmosphere, equation (1) 


i 

j 

I 


m 


n 


picture element 
spectral channel 
class of objects 
broad category of objects 
class of objects within a 


specified broad category 
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A bdr ( ) over a symbol Indicates a pattern or vector. 

The bracket < > around a parameter denotes expected i>iean value. 
The bracket [ ] around a parameter denotes matrix. 

The bars | | around a parameter denote determinants. 


RADIOMETRIC MODEL 

In this first section we present a simple radiometric model (see fig. 1) 
of solar irradiance. atmospheric transmittance, surface reflectance, and 
spacecraft imaging system re-,, jnse. The spectral region of interest is 
0.3 to 3.0 pm. While this model cannot be relied upon to yield quantitatively 
accurate results, it can nevertheless be easily used to gain some insight 
into the dependence of classification errors on differences between 
(simulated) actual and predicted imaging conditions. 


Solar Irradiance 

The absolute solar spectral irradiance S(X) above the atnwsphere is 
well known and changes slightly (less than 6 percent) with variations in the 
distance from sun to earth. We neglect tnese variations because their 
effect on a mul tispectral signal pattern is small. For examples, see 
references 10 and 1 1 . 


Atmospheric Transmittance 

The atmospheric spectral transmittance t(X, G) changes in time and 
locality with variations in scattering and absorption by various particles 
and molecules. Atmospheric transmittance severely distorts the signal 
pattern, and hence limits the accuracy of its classification. We neglect 
the diffuse sky radiation of the scene and the atmospheric path radiance. 
Their effects are generally less significant for the lighting and viewing 
conditions that are desirable for multispectral imaging, but must eventually 
be accounted for to obtain more accurate quantitative results. 

The slant-path transmittance of the atmosphere is (ref. 9) 


t(X, 0) « e 


-a(X) secO 

t 


(la) 


where a(X) is the extinction optical thickness along the vertical path 
from space to the earth surface, and secO is the ratio of the length 
of the vertical path to the length of the slant path. Tne 
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slant angle 6 ■ t for the Incidence path, and e ■ c for the emittance 
path. For slant angles larger than 62“, corrections must be made for 
atmospheric refraction (ref. 7). To simplify notation, It Is convenient to 
define t(X, i, c) as 


t(X, \, t) 


t(X, i)t(X, e) • e 


a(X)(seci ♦ secc) 


(lb) 


For the spectral region of Interest, the atmospheric transmittance Is 
primarily affected by Rayleigh scattering of air molecules (N2 and O2). 

Mie scattering of aerosols (water droplets and dust), and absorption by 
ozone (O3), water vapor (H2O), and carbon dioxide (CO2) (refs. 7 and 9). 
We neglect the height profile of particle density and molecular concentration, 
and account for the total optical thickness as 


a(x) * Nj^ o^(X) 6^(X) + Dq aQ(X) + a^^(X) ♦ Dq a^(X), (2) 


where N Is column density, D Is concentration, oq(X) Is the Rayleigh 
cross-section of air molecules, is the attenuation coefficient of 

aerosol, and ag(X), an(X), and ac(X) are selective absorption 
coefficients, respectively, due to O3, H2O, and other uniformly mixed 
gases of which CO2 has the dominant effect (ref. 10). 


Surface Reflectance 

The spectral reflectance p(X, i, c) of a surface Is generally a 
complex function of lighting and viewing geometry as well as wavelength. We 
neglect this complex dependence, and assume that the wavelength dependence 
of the spectral reflectance Is independent of the Incidence (i) and 
emittance (e) angle and that scattering is Lambertian. Hence, 


p(X, l, c) » C(\) COSl COSE, 


( 3 ) 


where p(X) Is coimonly referred to as spectral signature. Again, as 
for atmospheric effects, the surface reflectance must also be more 
realistically modeled to obtain useful quantitative results. 



The classification of surface targets from muUlspectral Image data relies 
on the observation that all physical and biological substances exhibit a 
uniquely characteristic spectral signature. Differences between spectral 
signatures may be easy to distinguish for diverse substances such as water, 
ice, dry sand, soil, and green vegetation. However, these differences 
tend to be very subtle and In practicr often difficult to distinguish for 
related substances such as different types of crops. Moreover, the spectral 
signature of vegetation, for example, varies with such factors as nnisture, 
season, soil, and growth density. Furthermore, various backgrounds can change 
the effective target radiance by a significant amount. For example, see 
references 10 and 14 to 21. 


Spectral Radiance 

Combining the solar Irradlance, atmospheric transmittances, and surface 
reflectance, we formulate the radiance N(X, i, c) sensed by a muUlspectral 
Imaging system as 


N(X, i, g) » S(X)t(X, i, c)p(X) c(i, e), (4) 


where 


1 

c(l, g) » - cost COSG. 

TT 


Imaging System Response 

We assume that the response Tj(X) of the j'th spectral channel of a 
J-channel mul ti spectral Imaging system Is represented by the function 


Tj(M 


1 X - X. ^ X - X. ^ X - X. 

. 3| . 21 M ]. 1 i|<l 

^ 


0 


otherwise 


( 5 ) 


shown in figure 2. The center wavelength of Tj(X) is X- and the effective 
rtidth is Aj. This function has been normalized so that 
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Tj(A) dX - 1. 


Photosensor Signal 

The Imaqinq system generates a photosensor signal for the spectral 
radiance N(X,i,e) that we represent as the J-dImenslonal vector 
(I.e., column matrix) S' with components 


an 



i, c)Tj(X) dX ♦ Dj, 


( 6 ) 


where Cj and Oj represent photosensor sensitivity and dark current offset, 
respectively. If'^sensUlvlty and offset variations are acvOunted for without 
error, then the components of t,h<j (calibrated) signal pattern S become 


S 


j 



N(X, i, e)Tj(X) dX 


(7) 


STATISTICAL MODELS 

In this second section we present two statistical models (see figure 3) 
for reference patterns and covariance matrices: a common model In which 

imagirig conditions are not accounted for, and a model In which they are 
accounted for to reduce classification errors. 


Definitions 

We regard for our two statistical models either the spectral radiance 
N(.\, i, g) or the spectral signature p(X) as a random process which for 
each X has a Gaussian probability density distribution. It follows that the 
photosensor signal in each spectral channel has also a Gaussian probability 
density distribution since equations (6) and (7) relate it to these functions 
by a linear process. 

We can define, therefore, the reference pattern for a class of objects 
(e.g., vegetation or wheat) as the J-dimensional vector R with components 
that are the expected (mean) signal value in each spectral channel as given by 
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Rj ■ E (Sj) . <Sj>. 


(8) 


These components are the features of that (hopefully) distinguish 
between signal patterns of various classes of objects. The associated 
covariance Is given by the symmetric J-dImenslonal matrix [oiii] with 
elements 


°jy " ^ ■ ’‘Sj.>)) (9) 


The covariance matrix can also be written as the product 


[Ojji] ■ [Oj][Yjj»][Oji]. (10) 

In this equation [oj] Is the diagonal matrix of the standard deviation 



with elements 
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And [Yjji] Is the synwetrlc correlation nwitrix 



] 


1 y,2 ••• 

^21 ’ ^2J 


( 13 ) 


Yjl Yj2 


with elements 



(14) 


Values of the non-diagonal correlation elements Yjji* j t J'. vary from 
0 to 1 , and may In practice sometimes be negative (ref. 22). 


Model 1 

Ge neral .- We define the expected (mean) value of the spectral radiance 
«(X, 1 , c) for a normal Incidence and emittance angle (I.e., i ■ e ■ 0) as 


E{N(X)) - <N(X)>, 


(15) 


and the (auto-) covariance as 


E([N(X) - <N(X)>][N(X') - <N(X')>]> » Cf^(X, X'). (16) 
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The components of the refe»*ence pattern R become then 


<T* ill 

R. - n f H{X)1A\) iix) - f <N(X)>T.(A) dA, 
and the elements of the covariance matrix become 

tii 

Ojj, • E{ f [N(A) - <N(A)>]Tj(A) dA f [N(A') - tN(A* 


ill I 

E'./ f [NtA) - <N(A)>][N(A') - <N(A')>]T.(A)T 
0 0 J 


III cr 

If A') Tj(\) Tj.(A') dA dA'. 


J 0 


Special case.- If N(A), N(A') are uncon elated and ' 

standard deviation of N(\), so that 


Cf^(X.A') • v;;{\) «(A - A'). 


then the covariance eleiiients become 


'JJ' ’ / 


( 17 ) 


)>]Tj.(A')dA'} 

..(A)dAdA') 


( 18 ) 


l^(A) is the 

( 19 ) 


(20) 
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If, furtheimore, the responses Tj(X), Tj,(X') do not overlap, then 



and the correlation matrix 



reduces to an Identity matrix. 


( 21 ) 


Model 2 

General . - We assume now that the Imaging conditions which we denote 
as 


I(X, i, g) * t(X, i, e) c(i, e) 


( 22 ) 


can be accounted for, and hence that the uncertainties associated with the 
spectral radiance N(X, i, e) are caused only by the random process which 
generates the spectral signature p(X). The spectral radiance has then 
the expected (mean) value 


E{N(X, i, e)} » <N(X, e)> « S(X) I(X, i, g) <p(X)>, (23) 


and (auto-) covariance 


E{[N(X. i, g) - <N(X, i, g)>][N(X', i, g) - <N(X', i, g)>]} 



Substituting equations (?3) and (24) Into equations (17) and (18) yields 
the reference pattern components 


R 


j 


f S(X) I(X, 1, g) <p(X)>Tj(X) dX, 


( 25 ) 


and covariance elements 



/ / S(X)S(X’)I(X.i.c)I(X\i.e)C (X.X')Tj(X)Tj.(X')dXdX'. (26) 
0 0 


Approximation.- To reduce the number of computations required for 
atmospheric Vompensat Ion, It might generally be desirable to approximate 
equations (25) and (26), respectively, as 


Rj ■ lj(>. £) "j 


(27) 


and 



Ij(i, e) Ij' (i.e)ojji 


(28) 


where 


I 



/ S(X) <p(X)> T.(X) dX, 
J 



OO I' 

» f f S(X)S(X’)C-(X.X’)Tj(X)Tj.(X')d\dX'. 
0 0 


(29) 


(30) 
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and 


ij(i. t) 


c(i. c) 



t(X, \, c) Tj(X) dX. 


(31) 


That Is, R' and [ojj*] are the reference pattern and covariance natrix, 
respectively, that represent the multispectral features of a class of objects, 
and Ij(\, e) is the factor by wUch these functions are corrected to account 
for imaging conditions. 

S pecial case .- If p(X), p(X') are uncorrelated and V (X) is the 

standard deviation of p(a), so that 


Cp(X, X') - Vp^(X) 6(X - X'), 




then the covariance elements become 


c 

'Jj' " /s^(X) V^(X) Tj(X)Tj,(X) dX. 


(33) 


If, furthermore, the responses Tj(^)» nverlap, then 


J S^(x) v^(x) T^(X)dX, j - j' 
0 


JJ 


(34) 


0 , 


j t j’ 
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CLASSIFICATION MODELS 


Classification Is essentially a process that assigns a large number of 
signal patterns S to a small numbe»* of reference patterns In this 
third section we present two types of classification decisions: one decision 
uses the minimum mean-square distance between the signal and reference 
pattern, and the other decision uses the ma x1 mum- 1 Ike 1 1 hood ratio. The 
latter is the optimum target detection process In many applications, and Is 
most conmonly used In the classification of multlspectral data. 


Mean- Square Distance 

We let be the signal pattern of pixel 1, be the reference 
pattern of a class of objects t, and Y|^. be the J-dImenslonal difference 
vector between these two patterns with components 


^tlj * ^1j ■ • 


(35) 


The mean-square distance (MSD) between a signal and reference pattern Is then 
g^ven by 






j-1 


tlj 


(36) 


The classification decision is to select the reference pattern for which 
the mean-square distance Is smallest, that Is, for which 


MSDj^,^ < MSD^^ , 


(37) 


where t * 1, 2, ... , L but t / £', and L is the total number of 
classes. 
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Maxlmum-Ukellhood Ratio 


General .- The J-dlmenslonal Gaussian probability density function (PDF) 
for computing the likelihood that the signal pattern belongs to the class 
of objects I Is given by 


PDF 


t1 




tjj' 


■ 1/2 


exp 




(38) 


where |Ojjj'| Is the determinant of the covariance matrix. The PDF^^ 

Is max1mu/h''when the signal pattern and reference pattern R|^ coincide 
(I.e., when ■ 0 for all j), and smootnly decreases with Increasing 

separation between these two patterns at a rate that Is controlled by the 
covariance. 

The logarithm of the PDF^^^ given by 


en PDF,^ 


1 

- -(J £n 2it ♦ in 
2 






(39) 


Is commonly used to avoid the computation of an exponential. The classifica 
tion iecislon Is then to select the reference pattern for which 


Itn PDFj^.J < |£n PDF^^ ] 


(40) 


where £*1,2,..., L but £ / £'. The term J £n 2-n can be neglected 
If J Is constant for all decisions, as Is usually the case. 

Special case .- If the components of the reference pattern R^ are 
uncorrelated, and hence the covariance matrix [ooji'] reduces to a 
diagonal matrix with elements given by equations (21) and (34) for the two 
statistical models, then the computation of equation (39) reduces to 


tn POFj, 



J „2 
j=1 °£jj 


(41) 
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ERROR MODELS 


In this fourth section we show how the radiometric and statistical 
rodels can be used to simulate the effect of errors In radiometric calibration 
ana atmospheric compensation on classification. Variations of the spectral 
signatures of a class of targets are already accounted for by the covariance 
<".atr1x 


Types of Errors 

Consider the following hypothesis and Its alternative*. 


"o- 5 

H, : S, < R. 


There are two types of associated errors: the type I error which Is to reject 

Hq when In fact Hq Is true (l.e., when pi(X) t. ot(X)), and the type II 
error which is to accept Hn when In fact Hi Is true (I.e., when 
:iC.) f P.(X)). 


Radiometric Calibration 

'/Je let c^j and Dij be the actual values of photosensor sensitivity 
and dark current offset, respectively, and <cj> and <Dj> be their 
expected values (I.e., the calibration data). The components of the 
calibrated signal pattern Sj are then given by 


M 



. -!ii. s . . 

<Cj> <Cj> 'J <Cj> 


(«) 
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where S|j are the components of the photosensor signal given by equation (6), 
and S^j "^are the components of the error-free calibrated signal given by 
equation (f). The components of the radiometric calibration error pattern 
Cr{ are then given by 


*^r1J " ^1j ■ ^1j " *^c1j ^1J * *^d1j* 


(43) 


where 


•clj 




(44) 


and 


<Cj> 


(45) 


Hence, we can account for the effect of errors In radiometric calibration on 
data classification by reformulating the components of the difference vector 
given by equation (35) as 


^tlj “ ^1j ' ^ '^rlj • 


(46) 


Atmospheric Transmittance 

If we do not attempt to compensate for atmospheric transmittance, then 
the components of the vector distance between signal and reference pattern 
become 
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I I I 1 I I I j ; I 1 1 i vi 


( 47 ) 


kV 



If, however, we could compensate for Imaging conditions without any error, 
then 



e)[p^(X) - <p^(X)>l Tj(X) dX 


(48) 


In practice, we can expect to introduce some error into the atmospheric 
compensation process by errors involved in estimating the concentration of 
atmospheric constituents and in simplifying computations by an approximation. 
In this case. 


^1j ■ “ ^ij ■ 

OO 00 

- / S(X)I^(X. 1, c)p^(X)Tj(X)d\ - <Ij(i, e)> / S(X) <pJX)>Tj(X)dX, (49) 


where the estimated imaging conditions are given by 


<Ij(i t e)> 


*<c(i. 



<t(X, i, e)> Tj(X)dX. 
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SYSTEM TOPOLOGIES 


In this fifth section we present three system topologies (see figure 4) 
for classification: one topology represents the usual single-level decision 
process, and the other two topologies represent two-level decision processes 
for reducing the number of computations required for classification. 


Decision Levels 

Single-leve l .- The single-level decision process shown in figure 4(a) 
classifies each signal pattern as one of L reference patterns . 

The selected pattern is denoted This process generates a spatial 

distribution of reference patterns that are generally highly redundant. The 
clustering process removes this redundancy by establishing regional boundaries 
for different reference patterns. 

Two -level .- It may be advantageous in some applications to edit the 
IncomFng sfgnal patterns; that is, to reject, for example, all data from 
clouds, or to accept all data from vegetation. In the two-level decision 
process shown in figure 4(b), a filter reduces data processing loads for a 
level-2 classifier by applying a simple decision rule to eliminate obvious 
cases from further consideration. Since the level-2 classifier needs to 
process only admissible classes, every time a signal pattern fails to be 
admissible, the level-2 data processing load is decreased (ref. 2). 

A further sophistication is introduced by the system topology shown in 
figure 4(c). We assume that L reference patterns can be grouped into M 
bread categories (e.g., clouds, water, soil, and vegetation) with each 
category containing up to N reference patterns (e.g., types of soil and 
vegetation) so that MN > L. Reference patterns that represent broad 
categories are denoted_ Rni» reference patterns that belong to a selected 
category are denoted R^'n* 

The supervisory (or level-1) classifier correlates all signal patterns 
with the reference patterns Rm, and informs the reference pattern library 
of each selection Rm. The library, in turn, sends the corresponding 
reference patterns R^'n to the level-2 classifier for further correlation 
with the signal pattern. It might in some cases be efficient to separate 
the signal pattern into two patterns, and » ”’th different 

spectral channels. ^ 


Computational Requirements 

Table I suninarizes the number of computations required to classify a 
signal pattern with the single and two-level decision process of figures 4(a) 
and (c), respectively, using either the mean-square distance (MSD) or 
maximum- 1 ike 1 i hood ratio (MLR) decision process. For comparison, let us 
assume that L * MN and * J 2 = J. The number of comoutation? wit^h the 
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i 1 J -1 


j 4 mmJ 


single-level topology Is then proportional to the product Ml, and with the 
two-level topology Is proportional to the sum M ♦ N. Clearly, 

MN 

14 V¥ ^ M > 2, N > 2. For example. If M ■ 4 and N ■ 10, ' n 

the single-level topology requires about three times as many computation:, as 
the two- level topology. 

The two-level topology with a supervisory classifier provides still 
further opportunities for reducing the number of computations If only a 
limited number of broad categories are of Interest so that the level-2 
processing load Is decreased each time a broad category Is rejected, or If 
the classification of broad categories requires fewer spectral channels 
(so that Ji > J2) and/or a simpler decision process. Potential reductions 
In computational requirements must, of course, be carefully traded against 
Increases In classification errors. 


SYSTEM PERFORMANCE AND DESIGN MODELS 

In this sixth and final section, we present an analytical model for 
the computer simulation of multlspectral data acquisition and classification 
based on the foregoing models and topologies. We describe also some general 
spacecraft system design approaches and alternatives that are suggested by 
these models and topologies. 


Analytical Model 

Figure 5 shows an analytical model for simulating various system 
configurations for multlspectral data acquisition and classification. The 
model provides the following options: 

(1) Single-level classification, using either the minimum mean- 
square distance or maximum-likelihood decision process. 

(2) Two-level classification, using the minimum mean-square distance 
decision process for supervisory classification and the maximum-likelihood 
decision process for level 2 classification. 

(3) Either one of the above topologies with or without compensation 
for Imaging conditions. 

To simulate clustering, we use the simple process of run-length encoding. 
The run-length encoder compares each selected reference pattern R^'i 
(or Rm'n'l) with the preceding pattern Rpi'i-l ^m'n'1-])’ passes 

each new pattern Rn,i< f R|p'i-1» counts each repetitive pattern 
^m'1 * Rm'1-1. Two-dimensional clustering algorithms that have been 
developed (refs. 24 to 28) are beyond the scope of our model. 
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Design Considerations 


Figure 6 shows a typical spacecraft Imaging geonietry, and figure 7 
shows a compatible signal processing flow diagram. The system uses the two- 
level decision topology with a single supervisory classifier and several 
level 2 classifiers. This topology offers not only some opportunities for 
reducing computational requirements and rates, but aUo a wide range of 
alternatives for the application of various technologies. Several level 2 
classifiers versus only a single supervisory classifier might be desirable 
since the level 2 classifiers must generally distinguish between more 
subtle differences In signal patterns. 

In addition to classification, the diagram accounts for a buffer memory, 
radiometric calibration, spatial registration of multlspectral data, 
compensation for Imaging conditions, and clustering of classified data. 

Data processing might be performed either with analog samples, digital data, 
or a hybrid system In which, for example, the supervisory classifier may 
use Integrated optics technology and the level 2 classifiers may use digital 
or charge-coupled devices technology. Compensation for Imaging conditions 
on the reference patterns rather than on the signal patterns promises fewer 
computations simply because there are fewer reference patterns than signal 
patterns. 

The system topology Is compatible with various Imaging techniques. 

We assume that the Imaging system provides an ir-^e sampling lattice of I 
pixels normal to the spacecraft flight path, and J spectral channels along 
the flight path (see figure 6). 

In an optical-mechanical scanner, J photosensors, each covered by a 
spectral filter, would be located along the flight path direction, and a 
servo- control led mirror would scan an Image of the scene past these 
photosensors In a direction that Is normal to the flight path. The analog 
signals that are generated along the line-scan direction would be electronical- 
ly sampled. 

In a pushbroom scanner, J linear photosensor arrays, each covered by a 
spectral filter and connected to a transport array, would be oriented normal 
to the flight path direction. The signals from the I photosensors of each 
array would be periodically transferred In parallel to an associated transport 
array, and nearly continuously readout In series from each transport array. 

The sequence of the spectral channels should be ordered according to their 
use In the classification process. The first Ji channels are Intended for 
the supervisory classifier, and the J 2 (<J) channels for the level 2 
classifiers. 

Other Image-sampling lattices could also be advantageous. For example, a 
spatial separation between the first J] channels and the remaining J-Ji 
channels could provide an Increased delay between the two levels of 
classifications. Or even two separate photodetection mechanisms could 
be envisioned: one mechanism for the supervisory classifier that would be, 
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for example, optimized for speed (perhaps at the cost of spectral and/or 
spatial resolution), and the other for level 2 classifiers that Mould be 
optimized for spectral resolution. This arrangement could conceivably 
lead to a change In the basic topology to permit the supervisory classifier to 
select different spectral channels and resolutions for the level 2 
classifiers. 

A buffer memory may be required to match a high data acquisition rate 
to a slower data processing rate and/or to change a discontinuous data 
acquisition rate to a constant rate for continuous data processing. Typically, 
the buffer might accept (or read) data during the active cycle of each line 
scan and transmit (or write) the same data at a slightly reduced rate during 
the complete (active olus passive) 11ne>scan period. In general. It appears 
to be desirable to match a continuous data processing rate to the average 
data acquisition rate so that the required storage capacity does not become 
excessively large. 

Calibration requirements of the mul tispectral signal will depend on the 
performance characteristics of the photosensors. But two typical processes 
can be anticipated: one Is subtraction of dark current offsets, and the 

other Is multiplication by calibration constants. 

The Image-sampling lattice requires that the data from all but the last 
spectral channel must be delayed for proper spatial registration. Data 
from the first spectral channels must be synchronized for the supervisory 
classifier, and must also be synchronized together with data from the remaining 
channels for the level 2 classifiers. (It might be desirable to Include 
these delays Into the buffer memory.) 

These delays could also provide corrections for geometric distortions 
called path skewing that are Introduced if the spatial coverage normal to 
the flight path Is obtained time sequentially (e.g., by an optical- 
mechanical scanner) rather than simultaneously (e.g., by a pushbroom 
scanner). 

Conceptually, the simplest approach is to let the supervisory classifier 
wait until all data from the J] spectral channels have been synchronized 
before starting its classification task, and similarly to let the selected 
level 2 classifier wait until the data from all J; channels have been 
synchronized. However, a classifier might also start its task as soon as 
data from two or more spectral channels have been synchronized, and use 
data from the following channels as they become available. The latter 
approach might offer some saving In time and in delay requirements. 

The supervisory and each level 2 classifier is anticipated to perform 
parallel correlations of the signal and reference patterns, and to identify 
the reference patterns that correlate most closely to the signal patterns. 

The result of the supervisory classification, which occurs first, is used to 
select the reference patterns for the level 2 classification, and the result 
of this classification is passed to a sequencing buffer. 
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The buffer sequences the selected reference codes Into proper order. 
Co**rect sequencing could be obtained either by sending the selected patterns 
In proper order to the buffer or by using synchronizing signals that allow 
the buffer to arrange these patterns In proper order. The first app»’oach 
appears conceptually easier. It could be Implemented by multiplexing the 
Incoming data to K level 2 classifiers together with the selected set of 
level 2 reference patterns. This scheme would assure that each level 2 
classifier would continuously process data at a rate that Is a factor of K 
slower than the basic data rate, and that the proper spatial sequence of the 
selected level 2 reference patterns could be easily maintained. To assure 
synchronization at the beginning of each scan line. It might be advantageous 
to let the ratio I/K be an Integer so that the first pixel In each line Is 
always processed by the first level 2 classifier. 

It Is the function of the clustering process to remove the data redundancy 
that results from classifying a large number of mul tispectral signal patterns 
into a few reference patterns. The simplest type of clustering is presented 
by the run-length encoder which reduces redundancy only along the line-scan 
direction (I.e., normal to the flight path). Its output consists of a 
succession of different pattern codes, eacn followed by the number of pixels 
for which the code was selected. A substantially more significant redundancy 
reduction could be accomplished with two-dimensional clustering algorithms, 
such as described and formulated In references 20 to 24. 

Compensation for atmospheric conditions might increase the accuracy 
of multispectral data classification more than any other advances in processing 
techniques for remote sensors. Two efforts have been advocated to achieve 
this (ref. 4): development of improved atmospheric models for computing 

atmospheric attenuation, and development of instruments for measuring atmos- 
pheric optical quantities simultaneously with remote sensing observations. 

Probably the simplest approach for estimating atmospheric effects would 
be to measure atmospheric conditions directly from periodically monitored 
targets concurrent with renxjte sensing observations (see, for example, ref. 5). 
Our approach to compensate for atnospheric transmittance suggests optical 
instruments that measure atmospheric attenuation in the same spectral bands as 
used by the spacecraft imaging system The spacecraft could trigger any 
ground-based instrument within its viewing range to make an atmospheric 
measurement and transmit the result to the spacecraft. An obvious disadvantage 
of this approach would be the requirement for a large number of optical 
instruments with a signal reception and transmission capability. This 
disadvantage would be further compounded by platform requirements for oceans. 

It would, therefore, probably be more desirable to augment the 
spacecraft imaging system itself witn an electro-optical device for 
("easuring optical properties of the atmosphere even if the measurement and 
signal processing technique is substantially more complex. The most important 
effects of atmospheric transmittance on the spectral radiance sensed by an 
earth-viewing imaging system could be distinguisned from surface 
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reflectance properties by their relatively narrow absorption features 
(nostly due to H2O and CO2) at well-defined wavelengths. Atmospheric transmit- 
tance due to scattering varies relatively slowly with wavelength and can, 
therefore, not be so easily distinguished, but Its distorting effect on the 
multlspectral signal features Is fortunately for the same reason less 
significant. Furthermore, It Is the concentration of water vapor, and hence 
absorption, that varies most rapidly with time and locality, whereas scattering 
due to particles and molecules (and. Incidentally, absorption due to CO2) 
are more constant. All this suggests that major deformations due 
to the atmosphere could be estimated with an atmospheric mode’ and measure- 
ments of the depth of a single absorption band for each constituent that Is to 
be accounted for. Atmospheric modeling has the added advantage that It 
can account for atmospheric conditions that cannot be readily nteasured from 
the spacecraft but that can be obtained from other observations. 


CONCLUDING RLMARKS 

Computer simulations of the analytical models and system topologies 
presented In this paper are Intended to provide a belter understanding of 
the effect of major error sources on multlspectral data classification, and to 
aid In the selection of spectral bands and the evaluation of various system 
topologies and special remote sensing techniques such as atmospheric compensation. 
However, the analytical models must be expanded to account more rigorously 
for atmospheric effects, target properties, and system component characteristics 
before their simulations can be relied upon to yield definitive results. 

Atmospheric effects must Include sky radiation and path radiance as 
well as transmi ttance; target properties must Include statistics about tne 
reflectances of various classes of objects and the dependence of these 
statistics on lighting and viewing geometry; and system characteristics must 
include realistic assessments of photosensor sensitivity and noise and of the 
transfer functions of analog and digital electronics and of such new 
technologies as integrated optics if and when they become available. This 
requires not only the consolidation of existing data about atmospheric 
effects and object reflectances, but also more extensive measurements and 
modeling of these properties. Such a systematic and comprehensive approach 
can be expected to lead to more efficient system designs for earth resource 
and environmental monitoring. 
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TABLE I.- COMPUTATIONAL REQUIREMENTS FOR THE CLASSIFICATION 

OF EACH SIGNAL PATTERN 


Decision 


Number of Multiplications 
and of Additions^ ' ) 

Topology 

Decision Process 

Single-level 

MSD^^^ 

2LJ < 2MNJ 


MLR^^^ 

+ 3J) < ^2^0^ + 30) 

Two-level with 

MSD for both 

2MJ^ + 2 NJ 2 

supervisory 

classifier 

levels 



MLR for both 

+ 30^)+ ^(0^^ + 3 ) 2 ) 


levels 


MSD for first 
level , and MLR 

2MJ^ + 2 (‘^2^ * ^*^2^ 


for second 


■ - - . - - 

level 

— 


number of multiplications and additions are equal to each other for 
both decision processes. (From ref. 23 for single-level topology.) 

^^^Mean-square distance. 

^^^Maximum-likelihood ratio. 
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Figure 1.- Lighting and viewing geonretry. 



0 .3 .4 .6 .8 T.0 1.3 1.4 1.6 




Figure 2.- Spectral response. 
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Figure 3.- Statistical models. 
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Figure 4.- Classification topologies 















Figure 5.- Analytical model. The topology represents two-level classification 
with (optional) spectral channel selection and compensation for 
imaging conditions. The model can also simulate single-level classi- 
fication with mean-square distance or max i mum- 1 ikel i hood decision. 










Figure 7.- Example spacecraft system topology 
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